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ABSTRACT 

The trend toward increased technology in traditional higher education classrooms has been met with both 
optimism and criticism. One of the major criticisms of technology in the college classroom is that it does 
little, if anything, to improve student learning. Taking this view of technology into account, this study 
examined how the use of technology contributed to student learning outcomes after controlling for key 
student demographic variables. More specifically, this study investigated the use of computer mediated 
conferencing (CMC) tools (i.e., email and electronic discussion boards) and computer aided instructional 
(CAI) resources (i.e., the computer and Internet) to determine whether they contribute to student learning. 


The sample utilized in this study consisted of 2000 college students, randomly drawn from the 2003 
College Student Experience Questionnaire database. The survey included 53 Likert scale items with 
reliability ranges from .78 to .88 on each of the composite scales. The analysis of data consisted of four 
multiple regressions conducted on specific student learning outcomes. The student learning outcomes 
included four composite scales, measuring student 1) personal and social development, 2) general 
education gains, 3) intellectual development, 4) science and technology gains, and 3) vocational 
preparation. 


After controlling for student's background variables, the findings of this study revealed that the use of 
technology in the college classroom does contribute to student learning. The model, including technology 
variables, explained 4% to 7% of the gains in student learning, while student background variables 
contributed an additional .03% to 2% of the gains. These findings, though modest, suggest that 
incorporating technologies in the college classroom can aid students in the learning process. 
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I. INTRODUCTION 

Advances in technology have created new channels for faculty-student interaction. Faculty members are 
becoming increasingly reliant on web-based technology as a resource for communication and a 
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supplement to course instruction. A study of technology in higher education in 2000 revealed that 60% of 
all college courses utilized electronic mail, as compared to 20.1% in 1995 [1], A similar increase occurred 
in faculty use of the world-wide-web. This same study showed that 43% of college instructors used web 
resources as a component of their syllabus, as compared to just 1 1% in 1995. These types of courses are 
referred to as “web enhanced” because they incorporate both traditional and electronic approaches to 
teaching and learning. 


Even with the tremendous growth in the use of web-based technologies in traditional college courses, the 
provision of new instructional tools for classroom instructors, and the i nn ovative course scheduling 
options offered to students, not much attention has been paid to the effectiveness of these new 
technologies in contributing to the college classroom experience. Few studies have examined whether 
these new pedagogical tools increase actual learning. As a result of this lack of attention to the 
effectiveness of new technologies, there has been a surge in research that examines the impact of 
technology on student performance. The growth of this research related movement started in the 1980s. In 
the early research, theoretical principles related to educational technology were resisted in the analysis of 
both the research and data [2]. This study examines the actual effects of web-based technology on student 
outcomes utilizing a constructivist framework for analysis. 


II. THEORETICAL FRAMEWORK 

Since the late 1970s, constructivism has become one of the most well known and widely used theories of 
learning and has served as a framework for the study of learning in educational research. Constructivism 
in learning theory suggests that learners develop understanding through their own beliefs grounded in 
their background and knowledge base, past experiences, and new experiences. A constructivist view of 
learning rests on the assumption that knowledge is constructed by learners as they attempt to make sense 
of their environments. Learners must interpret and transform complex information based on their own 
knowledge and experiences. The metaphors of carpentry or architecture can be used to portray the 
constructivists emphasis on a dynamic process of individual development of understanding through 
building, shaping, and configuring meaning [3], 


The emphasis of constructivist teaching is very different from the more traditional classroom lecture 
model, where lecturers seek to directly convey knowledge to students. Constructivism is based on the 
fundamental assumption that people create knowledge from the interaction of their beliefs, their existing 
knowledge, and the new ideas they encounter. Constructivists recognize the need to foster interaction 
between students and instructors. In the constructivist classroom, active student participation, peer 
interaction, critical thinking, and reflection are keys to learning. Additionally, collaboration is an integral 
component of the learning process. Within the schema of the constructivist model, learning becomes a 
communal activity that includes a focus on sharing cultural knowledge. Collaborative experiences provide 
students an opportunity to share understandings of course content, which promotes exposure to multiple 
perspectives. This additional exposure can, potentially, result in enhanced comprehension of course 
related materials. 


Web-based technologies act as tools that assist learners in knowledge discovery and as conduits for 
collaboration. In essence, they aid two of the key principles of constructivism. Web-based technologies 
support constructivist environments by assisting students in gaining a clearer understanding of key 
concepts and ideas by providing access to multiple data and information sources. Through the Internet, 
learners are able to work interactively to discover rich resources that enable them to solve problems or 
construct knowledge. Similarly, computer mediated conferencing tools facilitate student collaboration and 
provide new pathways for learner communication and interaction. This can be done using synchronous 


32 


Journal of Asynchronous Learning Networks, Volume 12: Issue 3-4 


The Effect of Computer Mediated Conferencing and 
Computer Assisted Instruction on Student Learning Outcomes 


and asynchronous communications where participants share information in pursuit of meaning and 
construction of knowledge [4], 


III. FACULTY AND STUDENT COMPUTER MEDIATED 
INTERACTIONS AND LEARNING OUTCOMES 

Research on faculty/student interaction tends to focus on the traditional face-to-face mode of 
communication. Fewer studies focus on newer technologies, such as email. Even so, the literature related 
to these new co mm unication technologies is expanding, and their findings appear to be mixed with 
respect to measuring student performance. For example, some studies reported positive results when 
teachers maintained daily e-mail contact with students [5, 6]. The results provide evidence that email can 
support learner knowledge and skill acquisition, and cognitive growth. Comparable results were also 
illustrated in Flowers’ and Zhang’s [7] study of 45,000 undergraduate students in the U. S. The results of 
this study showed that when students interacted with instructors via e-mail, they showed significant gains 
in science and technology knowledge, vocational skills development, personal and social development, 
and writing and thinking skills. 


Conversely, some studies have shown no significant gains in student learning through e-mail interaction 
with instructors. One such study reported that student performance was not significantly impacted by 
communication technology, regardless of the amount of personalized electronic message posting by 
course instructors [8]. Though outcomes were not measured by a specific variable such as knowledge 
gains, Woods’ study explored the ways students engaged in academic related activities to produce 
educational outcomes. More specifically, the study examined the extent to which personalized electronic 
messaging contributed to students’ perceived sense of community, their satisfaction with their overall 
learning experience, and their establishment of a personal relationship with their instructor. It was 
recognized that regardless of the number of personal electronic messages sent to students throughout the 
semester, there was no statistically significant difference in perceptions between groups that received 
personalized emails and those who did not. These findings stand in contrast to studies conducted by Hu 
and Ku [5], Yu and Yu [6], and Flowers and Zhang [7]. 


Haworth [9] took a similar approach to Woods [8] to investigate the effectiveness of sending frequent 
personalized electronic messages to students. The findings of this study suggest that messages contribute 
little to the amount of student participation in class discussions. Increased use of personalized messages 
was seen as complementary communication by students who only sent one or two messages during the 
semester. It appeared that the use of electronic messages did not significantly increase student-to-faculty 
interaction but redistributed the contact to an alternative form. Similarly, Haworth [9] and Woods [8], 
Gatz and Hirt [10] reported that their sample of traditional-age, residential, first-year students (n=23) used 
email quite extensively, but only a limited amount of their correspondence enhanced students’ ability to 
academically or socially integrate into their environment. Findings related to the effectiveness of learning 
through the use of email appear to be mixed, though there are slightly more studies showing the use of 
email can improve learning. The unresolved nature of these findings suggests that further exploration is 
warranted. 


IV. COMPUTER ASSISTED INSTRUCTION 
AND LEARNING OUTCOMES 

Computer Assisted Instruction is an interactive instructional technique that utilizes a computer to present 
instructional material, monitor learning, and select additional instructional material in accordance with 
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individual learner needs. CAI might also include Computer Supported Learning Resources (CSLR) which 
is the use of a computer as an access point for information. CSLR is a tool used by a learner in the 
learning process. In general, the literature suggests that the use of Computer Assisted Instruction (CAI) 
such as computer-based applications and the Internet, produce achievement effects superior to those 
produced through traditional instructional techniques [11, 12, 13]. These findings hold true for students of 
differing ages, abilities, and academic foci. 


Some researchers have compared the effects produced by different forms of computer-based instruction 
(sometimes alone and sometimes as a supplement to traditional instruction) with the effects of traditional 
instruction alone [12, 14, 15]. Yaccub [16] conducted a meta-analysis and concluded that on the average, 
higher gains are produced with CAI instructional methods than with traditional teaching methods. His 
findings showed that the effect size is likely to almost double from .35 to .64 when CAI is utilized. 
However, some findings have shown no significant difference between traditional teaching methods and 
CAI [17, 18, 19]. 


It is important to note that it is difficult to compare two different modes of delivery. It seems as though 
when this is done, it is likely to reveal no significant difference between the two modes [20, 21, 22]. Each 
delivery mode should be viewed as a method to enrich the learning experience. This was best 
summarized by Dalton and Hannafin [11] who wrote, "while both traditional and computer-based 
delivery systems have valuable roles in supporting instruction, they are of greatest value when 
complementing one another” (p. 32). Therefore, instead of comparing media types, it is best to study how 
a particular instructional strategy adds value to the instructional method being employed. The use of CAI 
should be examined from the perspective of how it contributes to and enhances the learning environment. 


Some studies have shown that CAI increases cognitive growth. One particular study analyzed the use of 
interactive media as an aid to students in a science course. At the end of the six week unit, there was an 
overall improvement of 24% in the number of correct responses, mainly in measures of higher level 
thinking skills, between pre- and post-tests. The findings revealed observable growth in both social and 
thinking skills. Media enriched and detailed examples of plant and animal fossils enabled students to 
better identify and classify them [23]. 


The use of CAI software has been reported to increase cognitive domain, higher-order thinking skills as 
well. Thornburg and Pea [24] examined the effect of using two software programs — Interactive Decision 
Envisioning Aid (IDEA) and Notecards — to train high school students in cognitive strategy and 
metacognitive strategy. The results showed that after the training in learning strategies from the software 
program, the breadth and depth of the subjects' argumentation improved significantly when compared to 
their knowledge and abilities prior to the instruction. Further, two months later subjects were able to 
retain these cognitive strategies. Though the sample size of the study (n=10) has the effect of weakening 
its impact, it still provides insight onto instructional design strategies that may have the potential to 
improve student cognitive performance. 


Utilizing different types of software in instructional design can promote different types of interactions and 
learning outcomes among students [25], Some researchers suggest that verbal interactions between 
students when using simulation software facilitate higher-order thinking by promoting peer interaction for 
problem solving [26], Flowers and Zhang [7] found that using a computer for word processing, searching 
for information on the Internet, and analyzing quantitative information resulted in significant gains in 
writing and thinking skills. Word-processing software has been reported to encourage students to find 
solutions to a wide range of writing problems when used in a collaborative writing environment that 
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encourages extensive discussion [27]. 


Other researchers have reported that students are able to work longer and develop a better understanding 
of the writing process by working cooperatively on a writing task [28]. The word-processing environment 
is ideal for motivating students to discuss, reflect upon, and edit their work within cooperative groups. 
Additionally, participation and collaboration among students increases when they use computers in 
groups [29]. Word-processing applications also allow for more fluid, collaborative learning environments 
which are likely to produce a higher quality of interaction [27]. Users have the ability to add, delete, and 
rearrange text, allowing more congruency in the writing process than pencil-and-paper approaches. In 
turn, the use of word processors leads to better writing outcomes than the use of paper-and-pencil or 
conventional typewriters. Such outcomes include longer writing samples, a greater variety of word usage, 
a greater variety of sentence structures, more accurate mechanics, better spelling, more substantial 
revisions, greater responsiveness to teacher and peer feedback, better understanding of the writing 
process, better attitudes toward writing, and freedom from the problem of illegible handwriting [16, 30, 

31]. 


V. PURPOSE OF THE STUDY 

The purpose of this study is to determine whether a sample of students who frequently use newer 
communication tools, such as email threaded discussions, achieve significant gains in learning outcomes. 
More specifically, this study will examine: 


1) The frequency of use of online collaboration (i.e., email, threaded discussions, or relay chat) and 
whether collaboration contributes significantly to student outcomes. 


2) The frequency use of computer assisted instruction (i.e., computer and Internet) and its contribution to 
student outcomes. 


VI. METHODS 

This study utilized data from the 2003 College Student Experiences Questionnaire (CSEQ) database, 
which is housed at the Center for Postsecondary Research. The CSEQ is a national survey of randomly 
selected undergraduate students from colleges and universities across the United States. Institutions elect 
to participate in a paper-based version or a web-based version of the CSEQ survey. This study consists of 
a secondary data analysis of the web-based version of the 2003 CSEQ. 


Invitations to participate in the survey were sent electronically. Student e-mail addresses were gathered 
from Fall 2002 enrollment data provided by participating institutions. Codes were developed by the 
agency administering the survey to track participant institutional affiliation. Data collection took place 
between May 2003 and September 2003. Participating institutions applied to CSEQ to become survey 
sites. Each institution provided email addresses for its student participants. A general announcement was 
sent (see Appendix A), inviting students to participate in the survey beginning in February of 2003. The 
survey web-site was open for three months. A hyperlink was embedded in the text of the email invitation, 
which directed participants to the instrument. To prevent multiple responses from the participants, 
students were required to submit contact information (e.g., name, social security number, and phone 
number), and if duplicates and non registered names were found, they were automatically removed. A 
follow-up email announcement was sent to non- respondents in April as a reminder. The web-based 
survey was closed and removed from the internet server in early September of 2003. 
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The CSEQ questionnaire is based on extensive research and guided by Chickering and Gamson’s (1987) 
“Seven Principles for Good Practice in Undergraduate Education.” The instrument utilized in this study 
includes 190 Likert-type items that relate to student academic experiences. For the purposes of this study, 
53 items were selected from the two scales: 1) Estimate of Educational Gains (general education, personal 
development, science and technology, intellectual skills, practical and vocational competence) and 2) 
engagement (student acquaintances). Additional demographic data were collected in the latter sections of 
the instrument. The demographic variables included age, martial status, gender, race, living situation, 
educational status, parents’ education level, and major field of study. For this study, only the gender, 
race, and educational level demographic variables were utilized. 


The sampling frame for this study included students from various colleges and universities across the 
United States. The study operationalized a random selection in a sub-sample of 2,000 participants from 
the total national sample (n=87,855) of students who completed the CSEQ survey in 2003. The random 
sample was primarily composed of participants who were enrolled in some form of online instruction. 
The national sample included students enrolled in both online and traditional courses. 


A comparison of the random sample and national sample clearly demonstrates the demographic 
similarities of the two groups. Most of the participants were female (63%), slightly higher than the 
national sample (61%) of women enrolled in four year institutions. Caucasian/White students made up 
the majority of the sample (78%), which is somewhat higher than the national sample (76%). The largest 
percentage difference between both groups was the enrollment status with a 1 9% difference between the 
random and national sample of freshman and sophomores sampled. Table 1 provides a demographic 
comparison between the random and national sample of the CSEQ participants. 


The questions chosen for analysis in this study were based on a constructivist framework. First, 
demographic characteristics were analyzed to determine the effect that student background had on student 
learning outcomes. Second, questions related to student’s ability to manipulate technology to expand their 
sphere of knowledge and to leverage the technology for gains in understanding were studied. Finally, 
student interaction and collaboration in the learning process were analyzed. 


A. Reliability 

Reliability is the consistency of measurement, or the degree to which an instrument measures the same 
way each time it is used under the same condition with all participants. Another characteristic of a reliable 
instrument is stability; the degree to which participants respond in similar ways at two different points in 
time. For this purpose, Cronbach’s Alpha was used. It ranges from 0 to 1.0. Scores that are at the higher 
end of the range (e.g., above .70) suggest that the items in a scale are related. 


The Alpha coefficients for the learning outcomes scales range from .78 to .88, suggesting high reliability. 
Table 2 outlines the items and internal consistency estimates associated with the student learning outcome 
scales. 

B. Measures 

The measures used in this study will be outlined in two sections: dependent variables and independent 
variables. 
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1. Dependent Variables 

Five student learning outcomes attributed to the college experience were assessed: 1) personal and social 
development, 2) general education, 3) intellectual development, 4) science and technology, and 5) 
vocational preparation. An analysis from the Buros Mental Measurement Y earhooks show that the items 
on the CSEQ scales are clear, well defined and have face validity, showing that logical relationships exist 
among same scales items [32]. 


Items on the questionnaire were measured on a 4 point Likert scale: 4 = Very Often, 3 = Often, 2 = 
Occasionally, 1 = Never. Cronbach’s alpha estimates for the five scales were: 1) general Education, 
measured by six items (a = .79); 2) gains in intellectual skills, measured by seven items (a =.80); 
personal and social development measured by five items (a = .82); 4) gains in science and technology 
measured by four items (a = .89); 5) and three items measured gains in vocational preparation, (a = 
.78) Details on item wording, means, standard deviations and descriptive statistics estimates of measures 
are shown in Table 2. 


2, Independent Variables 

The independent variables or predictors for this study included 1) frequency of interaction via email, 2) 
frequency of collaborative work online, 3) frequency of computer use to prepare papers or reports, 4) 
frequency of use of the Internet for course related information. Participants responded to a 4 point scale: 
4= Very Often, 3= Often, 2= Occasionally, 1= Never. All independent variables were measured as single 
items. Details on item wording, descriptive statistics, means, and standard deviation estimates measures 
are shown in Table 3. 


C. Sets of Correlations 

Inter-scale correlations were conducted on the independent and dependent variables to gain a better 
understanding of the strength of the scales. The results showed that there were significant correlations 
among the scales (p<.05). Correlations for the dependent variables were conducted first to measure 
learning outcomes. The r - values ranged from 20% - 75%, with the majority of the correlations falling 
within the 27% - 55% range, indicating a moderately strong relationship as shown in Table 4. The scale 
relating to students’ personal and social development and intellectual skills showed the strongest 
relationship (r. =75). The scales with the lowest correlations were the social interaction scale and 
vocational preparation scale (r= .201). 


A second set of correlations was conducted on the independent variables. Results showed moderate to low 
correlations on using email to communicate while the use of computer word processors presented the 
highest correlation at r =.480. Using email to communicate with classmates and joining in electronic 
discussions reported the lowest correlation at r = .134. All items showed a positive relationship and were 
statistically significant (p<.01) as displayed in Table 5. 


VII. DATA ANALYSES 

Data analyses were conducted using SPSS Version 12. Frequencies, descriptive statistics, and 
distributions were examined for all variables. Histograms, normal probability plots, and scatter plots 
were also created to determine whether the assumptions of linearity, normality, and homoscedascity were 
met. Item level analyses were carried out prior to creating the composite variables, and reliability 
estimates were calculated for each composite. 
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Multiple regression statistical analyses were conducted to analyze the data and find the best predictors of 
the dependent variables as they relate to learning outcomes. Regression was used to determine the 
contribution of the four interaction and technology use variables, above and beyond the impact of 
demographic factors, to the prediction of the outcome variables (i.e., learning outcomes). 


The variables used in the regression equation were categorical in measure. To meet the assumptions of the 
model operationalized in this study, it was necessary for the dependent variable to be quantitatively or 
continuously measured. Dummy coding is the most commonly used coding method used to group data 
according to categories. Utilizing dummy coding, association in a given group or category was assigned a 
1, whereas non-association in the category was assigned a 0. Groups that were given a 1 were expected to 
have higher learning outcome effects. For the purpose of the regression analyses, categorical variables, 
such as student gender, race, and class were coded as dummy variables. The specifications and the coding 
of the independent variables are listed below: 


Gender. Student gender variable was dummy coded as: 

0 = Male 

1 = Female 

Race. The race variable is dichotomized into Whites and non-Whites because of the low percentage of 
minorities represented in the sample. It was dummy coded as: 

0 =Non- White 

1 =White 

Class level. In this study, the class level variable is coded into two categories: 

Lower - mid level (freshmen, sophomores, and juniors) and seniors. The variables were coded as: 

0 = Freshmen, Sophomore, Junior 

1 = Senior 


After coding the dummy variables, independent variables were entered in two blocks for each regression 
analysis. The demographic variables were entered into the first block, and then the group of interaction 
and technology use variables were entered into the second block. Thus, the independent contribution of 
each of the interaction and technology use variables could be estimated. 


This study was based on the central assumptions that a) frequent use of computer mediated conferencing 
tools for collaborative interaction would result in greater learning outcomes, and that b) frequent use of 
computer assisted instruction would result in greater learning outcomes when demographic characteristics 
have been controlled. 


VIII. RESULTS 

As expected, the findings revealed that the use of technology does assist in explaining a significant 
amount of variance in learning outcomes, when demographic characteristics are held constant. For the 
data analysis both the unstandardized and standardized regression coefficients are reported in the tables. 
The interpretability of the unstandardized coefficients is somewhat challenging because the measures are 
truly not interval measures. Interval variables are equally spaced and have to represent equal magnitudes. 
It is unlikely that the unstandardized coefficients from the scale used (1= never to 4 = very often) would 
yield equal magnitude (e,g., there could be more gains from moving from never to occasionally than from 
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often to very often); therefore, the standardized coefficients will be used to gauge the relative importance 
of the independent variables in the explanation of student learning outcomes. 


IX. REGRESSION MODELS FOR STUDENT LEARNING OUTCOMES 

The focus of this study was the effect of CMC and CAI on student learning outcomes, after controlling 
for background variables. The five student learning outcome variables were regressed against the student 
background factors and technology use variables. The technology use variables were general education 
gains, personal and social development gains, intellectual gains, science and technology gains, and 
vocational gains. The regression models for student learning outcomes are summarized in Table 6. 


The first regression model measures the contribution the use of technology made to students’ general 
educational outcomes, revealing that background variables explain .003% of student learning. Contrary to 
initial expectations, the background variables do not make a significant contribution to gains in general 
education. When technology variables are added to the model, there is an R 2 change of 4%. Of the 
technology use variables, frequency of participation in electronic classroom discussions has the greatest 
effect on general education gains (B=.l 1), followed by searching the internet for course material (B=.10). 
The background and use of technology variables together explain about 5% of the total variance in 
general education gains (p<.001). 


When examining learning outcome variables, the student characteristics of being white and being a senior 
appear to be fairly consistent. Background variables have a relatively small effect on student learning 
outcomes (.008% - 2.0%) for each of the five models. There is a slight negative association with being 
white in relation to each of the learning outcome variables, though none of the beta values are statistically 
significant. In contrast, being a senior is positively associated with all of the learning outcome variables. 
Three of these associations are significant (i.e., personal and social development, intellectual gains, and 
vocational gains). Being female is found to be positively associated with gains in personal and social 
development. There is also a negative relationship between being a female and gains in the area of science 
and technology. This negative relationship was found to be significant. 


When the CAI technology related variables are included in the models, the resulting effects are fairly 
consistent across all of the learning outcome variables. Both searching the Internet and participating in 
electronic class discussion are key variables that help explain learning outcomes. In all five models, R 2 
change was modest (3% - 7%) and statistically significant, indicating that the frequency of technology use 
does indeed contribute to the explanation of gains in student learning after controlling for background or 
demographic factors. 


X. DISCUSSION 

The researchers assumed that frequency of technology use would explain learning outcomes after 
controlling for background characteristics. The findings show that this assumption held true. In fact, the 
use of technology explained nearly four times as much of the variance in student learning as background 
variables. However, the relative effect of technology on student learning gains is not as great as initially 
assumed. Nonetheless, the learning outcomes percentage gain of 3-9 percent does provide a modest 
explanation of the effects of technology on learning within the context of educational psychology. 


In the area of learning cognition, many factors contribute to student learning. Key areas that contribute to 
learning include teacher/instruction related variables [33], student-related variables [34], personal 
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characteristics [35], learning styles [36], and environmental elements [37]. Yet, by most standards, the 
ability of learning tools and/or resources to contribute to learning suggests a need for a regression model 
that focuses on learning gains. The effectiveness of learning technology tools combined with traditional 
instruction have typically contributed moderately to the overall gains in learning [31, 38]. 


XI. TECHNOLOGY AND ITS INFLUENCE ON LEARNING 

OUTCOMES 

A. Computer Mediated Learning Tools 

When taking into account only the use of computer mediated learning tools (email and electronic 
discussion), the findings in this study showed each was effective in explaining gains in learning outcomes 
(i.e., general education, personal and social development, intellectual growth, science and technology, and 
vocational gains). The findings of this study suggest that the utilization of collaborative learning tools 
modestly supports students in their learning processes. Additionally, collaborative learning tools facilitate 
discussion, and interaction among students and faculty. 


The electronic discussion boards allow students to become active participants and they encourage both 
reflection and interaction [29], Previous studies on collaborative learning have reported a moderate to 
strong relationship between various modes of collaboration and student performance [39, 40]. A possible 
explanation for the positive association between CMC utilization and learning gains is the effectiveness 
and ease of its use. More specifically, CMC allows discussions to be easily transmitted, stored, archived, 
reevaluated, edited, and rewritten. In addition, students enjoy a level of comfort with the more candid 
nature of CMC when sharing and discussing personal information that they may not in a face-to-face 
format. Thus, CMC can improve the overall quality of discourse [5, 41], 


Studies of the contribution of CMC to learning by type of media have not shown strong evidence to 
support one mode of delivery over another. However, the findings from this study record only one 
significant relationship in learning gains through the use of email, and it was specific to personal and 
social gains. Both Haworth [9] and Woods [8] found the use of email to have positive effects on student 
academic and social integration. Though the methodologies of their studies are different, Haworth 
investigated online students and the types of messages sent while Woods examined online students and 
the frequency of messages sent, they both showed email having moderate effects as a learning tool. The 
results of this study showed that electronic discussions were more effective than email in explaining 
learning gains. Both electronic discussion boards and email are modes of asynchronous communication 
with similar user control features. The major difference between the two is that electronic discussion 
boards are centralized and controlled by the sender while email is decentralized— typically remotely 
located on the end users personal computer though still controlled by the sender. 


The use of email is a favored communication tool for students who had an average mean score of 3.74 on 
a 4 point scale on the instrument used for this study. This score indicates that students used this method of 
communication very often. The electronic discussion boards had an average mean of 2.05, showing that 
students occasionally used this method. Although students’ demonstrated a preference for email, it is 
possible that email is being used more for social communication than for academics. Additional evidence 
of this conclusion comes from this study’s findings that students who use email show significant gains in 
the area of personal and social development and did not show gains in any other learning outcome area 
besides relatively small gains in science and technology. Though only a general conclusion can be drawn 
from this one finding, it does reveal a possible pattern. Additional research is warranted to gain a better 
understanding of why differences in effectiveness may exist between these two modes of electronic 
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communication when examining learning gains. 


B. Computer Assisted Instruction 

Two additional modes of technology investigated are classified as CAI tools (i.e., use of the computer 
word processor and the Internet). CAI tools allow learners to discover knowledge at their own pace. This 
is considered an exploratory form of learning. The Internet is a key piece of CAI related exploratory 
learning, allowing learners to search, retrieve, and evaluate information as it is displayed and permitting 
users to be in control of their quest for information. Findings from this study reveal that the use of the 
Internet is a moderate contributor to actual student learning outcomes. Searching the Internet has the 
greatest effect on three of the five learning constructs. 


Though the effect size is moderate, the findings suggest that the Internet can be a somewhat effective tool 
in facilitating student learning. This finding is fairly consistent with other studies which showed that 
using the Internet allowed exploratory learning to occur that improved student academic performance [6, 
7, 38]. Positive effects are likely to be associated more closely with ease of access and retrieval of 
educational resources on the Internet [6], As the quality and abundance of resources on the Internet grow, 
it is likely that more positive learning gains may be seen. 


It is somewhat surprising for the researchers not to find a significant relationship between the variable of 
computer use and learning, particularly since it is the most popular learning tool of all the technology 
variables. The use of a computer for projects or reports yielded the highest mean score (3.83 on a 4.0 
scale) out of all the technology resources, showing that computers are frequently used learning resources 
for students. The impact computers can have on learning is further supported by other studies which have 
found that computers aide students in their cognitive growth [30, 42, 43], 


The lack of effect of computer use on learning gains is likely due to its association to the term “word 
processor.” Because “word processor” was a separate independent variable and carried with it the 
suggestion that it enables learners to write papers for classes, this definition could have affected student 
responses on computer use. Students may use a word processor to write on topics such as politics and 
diversity, but not necessarily use to interact with faculty and other students, thus engaging in learning 
related activities. Students may use a computer word processing system to write papers and not 
necessarily use it as an interactive learning tool. 


Some of the questions that measure learning outcomes revolve around the actions of search, retrieval, or 
interaction. The use of a computer does not necessarily provide an outlet for interaction unless a particular 
type of software is adopted to facilitate this process. For example, one of the questions that measures 
general education gains asked students to rate their efforts in developing an understanding and enjoyment 
of art, music, and drama. If students associated a computer with word processing, then it would be 
difficult for them to develop an appreciation for the arts because word processors are not used for this 
function. Quite the opposite is true for using the Internet. The Internet provides the capability to explore, 
view, and listen to files associated with the arts. A computer can have these same capabilities if the 
software permits. Because students may have associated the computer as just a word processing tool, the 
responses were likely distorted. 


A second possible reason the use of a computer did not play a significant role could be a reflection of the 
instructional design, though this is a speculative assumption. This study was not designed to examine how 
technology is being used as an instructional strategy; however, it is known that simply providing learners 
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with hyperlinks to various websites will not yield productive results [44]. There must be an incorporation 
of instructional design principles, (i.e. content and learner analyses) to determine what students should 
know and be able to do with information [45]. Therefore, if proper instructional guidelines are not 
applied, it is unlikely that any measurable learning will result. 


XII. IMPLICATIONS 

The findings of this study have two immediate implications for instructional practice. First, the findings 
reveal that the use of electronic communication and computer-based resources provide complementary 
learning activities that aid the learning process. There is great interest and potential in web-based, 
flexible, learning with over 60 percent of instructors incorporating some form of technology as a part of 
their instruction [1], While instructors are the focal point in most course settings, it should be noted that 
complementary learning activities are just as, if not more, important for practice. Research has proven that 
most learning occurs outside of the classroom environment and is strongly correlated with academic effort 
[46, 47]. Technology based learning resources provide important support in the classroom and 
complement what is being taught. Teachers should utilize technology-based resources to help learners be 
creators of knowledge through information research and content evaluation. These types of skills assist 
learners in becoming critical explorers rather than passive observers. 


A second implication, related to instructional practice, is the need to select the appropriate media and to 
decide on the frequency of its use. Both the media and the frequency of use have the potential to enhance 
student learning outcomes if chosen and managed properly. Technologies that are capable of engaging 
students in interactive discussion with the instructor, peers, or an academic community can improve 
learning. Email and discussion boards were seen as the most effective technologies for facilitating 
interactive discussions. However, there must be a concentrated effort to develop strategies that promote 
subject matter relevant dialogue during the instruction development phase. These strategies need to take 
into account the frequency of access to, and duration of time spent on course content. Since in-class 
instruction is often limited, efforts should be made to encourage out of class learning activities that 
challenge students to probe, explore, clarify, explain, evaluate, and analyze written content with others. 
This provides student users the opportunity to learn from one another, using collaborative learning 
methods. 


XIII. IMPLICATIONS FOR FUTURE RESEARCH 

There are many opportunities for new studies on computer and web-based learning utilizing the 
constructivist theory as a general guideline. However, for the purpose of this study, two specific 
opportunities will be discussed. First, there is a need to examine other variables to advance the research in 
this area. Though finding good fitting prediction models was not the intention of this study, the models 
used herein had a relatively low R-square; that is, the independent variables and the control variables 
together only explained a small portion of the variances in learning outcomes. This relationship suggests 
that there might be other variables that have more significant effects on learning, which were are not 
included in the models used. 


A second study to follow up on some unanswered questions regarding the definition of computer use 
would clarify any misconceptions between a word processor and computer. A computer serves as an 
electronic device that can store, retrieve, and process data. More important, perhaps, is to the need to 
clarify the differences in a computer and the software that can be used to complete certain tasks. Today, 
there are thousands of programs that enable computers, to design, to store, and to manipulate data in a 
manner that makes it easy for an individual to see them as one unit. It is very rare to purchase a computer 
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without any preinstalled software. Therefore, a follow up study would clarify any definitions or terms to 
ensure that there is a direct correlation between computer use and the task it enables users to complete. 
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Table 1. Characteristics of CSEQ 2003 Sample 


Characteristic 

Online Sample 
n % 

Online 
Sample n 
(n=2000) 

National 
Sample n% 

National Sample 
n (n=87,855) 

Gender 





Male 

35% 

704 

39% 

33,560 

Female 

64% 

1,272 

61% 

53,485 

Race 





African American 

4.6% 

92 

5% 

4,356 

American 

Indian/Alaska Native 

.7% 

13 

1% 

844 

Asian/ Pacific Islander 

4.8% 

96 

9% 

7,529 

Caucasian/White 





Hispanic 

78% 

1,568 

76% 

67,277 

Other 

3% 

59 

2% 

1,630 

Multiple 

2.9% 

57 

3% 

2,597 


3.7% 

73 

3% 

3,090 

Enrollment Status 





Freshman 

20% 

399 

42% 

36,733 

Sophomore 

41% 

823 

20% 

17,506 

Junior 

11% 

222 

17% 

15,096 

Senior 

25.7% 

513 

21% 

18,520 
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Table 2. Items and descriptive statistics for learning outcomes 
Items and descriptive statistics for learning outcomes 


Variable 

Scale 

Items (with Codes) 


Item-Level Statistics 


Statistics 


Mean 

Standard 

Valid 





Deviation 

N 

General Education 



2.81 

.893 

1824 

at=79 as=79 

GNVOC 

Acquiring knowledge and skills 
applicable to a specific job or type 
of work (vocational preparation) 

3.01 

.807 

1824 


GNSPEC 

Acquiring background and 
specialization for further education 






in a 






professional, scientific, or scholarly 
field 





GNGENLED 

Gaining a broad general education 
about different fields of knowledge 

3.06 

.758 

1824 




2.51 

.946 

1824 


GNARTS 

Developing an understanding and 
enjoyment of art, music, and drama 

2.46 

.974 

1824 


GNL1T 

Broadening your acquaintance with 
and enjoyment of literature 

2.69 

.932 

1824 


GNHIST 

Seeing the importance of history for 
understanding the present as well as 
the past 

2.65 

.955 

1824 


GN WORLD 

Gaining knowledge about other 
parts of the world and other people 
(Asia, Africa, South America, etc.) 

2.94 

.831 

1824 


GNPHILS 

Becoming aware of different 
philosophies, cultures, and ways of 
life 




Intellectual Skills 

GNWRITE 

Writing clearly and effectively 

2.98 

.834 

1826 

at=.81 as=.80 

GNSPEAK 

Presenting ideas and information 
effectively when speaking to others 

2.95 

.833 

1826 



Using computers and other 

3.05 

.864 

1826 


GNCMPTS 

information technologies 
Developing good health habits and 

2.64 

1.006 

1826 


GNHEALTH 

physical fitness 






Thinking analytically and logically 

3.05 

.825 

1826 
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GNANALY 





GNSYNTH 

Putting ideas together, seeing 
relationships, similarities, and 
differences between ideas 

3.14 

.765 

1826 



3.28 

.755 

1826 

GNINQ 

Learning on your own, pursuing 
ideas, and finding information you 
need 




Note: at is the alpha for the national sample and as is the alpha for the sub-sample. 


Table 2 (Continued) 

Variable 

Scale 

Items (with Codes) 


Item-Level Statistics 


Statistics 


Mean Standard 

Valid N 





Deviation 


Personal and 


Developing your own values and 

3.18 

.828 

1834 

Social 

Development 

GNVALUES 

ethical standards 




at=.83 as=.82 

GNSELF 

Understanding yourself, your 
abilities, interests, and personality 

3.31 

.717 

1834 



Developing the ability to get along 

3.21 

.778 

1834 


GNOTHERS 

with different kinds of people 
Developing the ability to function as 

3.03 

.862 

1834 


GNTEAM 

a member of a team 






Learning to adapt to change 

3.18 

.787 

1834 


GNADAPT 





Science and 

GNSCI 

Understanding the nature of science 

2.36 

.983 

1849 

Technology 


and experimentation 




at=.87 as=.89 

GNTECH 

Understanding new developments in 
science and technology 

2.40 

.962 

1849 


GNCONSQ 

Becoming aware of the 
consequences (benefits, hazards, 
dangers) of new applications of 

2.44 

.943 

1849 



science and technology 

2.58 

.973 

1849 


GNQUANT 

Analyzing quantitative problems 
(understanding probabilities, 
proportions) 




Vocational 

Preparation 

GNCAREER 

Gaining a range of information that 

3.06 

.782 

1848 


48 


Journal of Asynchronous Learning Networks, Volume 12: Issue 3-4 


The Effect of Computer Mediated Conferencing and 
Computer Assisted Instruction on Student Learning Outcomes 


at=.78 as=.78 


2.81 .983 1848 

GNVOC Acquiring knowledge and skills 

applicable to a specific job or type 
of work (vocational preparation) 

3.01 .809 1848 

GNSPEC Acquiring background and 

specialization for further education 
in a 

professional, scientific, or scholarly 
field 

Note: at is the alpha for the national sample and as is the alpha for the sub-sample. 


Table 3. Items and Descriptive Statistics for Independent Variables 
Items and descriptive statistics for independent variables 


Independent 

Variables 

Items 

Mean 

Standard 

Deviation 

Valid 

N 

Frequency of 
interaction via 
email 

Used email to communicate with an 
instructor or other students 

3.74 

.567 

1903 

Frequency of 
collaborative 
online Work 

Participated in class discussions using an 
electronic media (email, list serve, chat 
group, etc.) 

2.05 

1.045 

1903 

Frequency of 
computer use to 
prepare papers or 
reports 

Used a computer or word processor to 
prepare reports or papers 

3.83 

.471 

1903 

Frequency of 
Internet use for 
course related 
information 

Searched the World Wide web or Internet 
for information related to a course 

3.51 

.723 

1903 
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Table 4. Correlations among Dependent Variables 
Correlations among Dependent Variables (N = 1921) 


Dependent Variables 

General 

Education Scale 

Voc Scale 

Sci. Tech Scale 

Per. Soc. 
Scale 

Intellectual 
Skills Scale 

General Education Scale 

1 





Voc. Scale 

.607** 

1 




Sci. Tech Scale 

.368** 

.438** 

1 



Per. Soc. Scale 

541 ** 

.489** 

.410** 

1 


Intellectual Skills Scale 


.526** 

.534** 

749 ** 

1 


** Correlation is significant at the 0.01 level (2-tailed). 


Table 5. Correlations among Independent Variables 
Correlations among Independent Variables (N = 1921) 



Used 





computer/word 

Used email to 

Joined in 


Independent 

processor for 

communicate with 

electronic class 

Searched Internet 

Variables 

paper 

class 

discussions 

for course material 

Used 

computer/word 
processor for 

1.00 




paper 

Used email to 
communicate with 
class 

.480** 

1.00 



Joined in 

electronic class 

discussions 

.134** 

.192** 

1.00 


Searched Internet 
for course 

material 

.346** 

.412** 

.279** 

1.00 


** p< .01 
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Table 6. Regression Model for Technology and Student Learning Outcomes 
Regression Model for Technology and Student Learning Outcomes 


Independent 

General Education 

Personal and Social 

Intellectual Gains 

Science and 

Vocational Gains 

Variables 

Gains (V=1768) 

Development Gains 

(V=l 779) 

Technology Gains 

(V=1791) 




(7V=1768) 



(A/=1790) 




b 

B 

b 

B 

b 

B 

b 

B 

b 

B 

Gender 

-.01 

-.001 

.09** 

07** 

.14 

.01 

- 24*** 

j4*** 

-.03 

-.02 

Race 

-.19 

-.02 

-.03 

-.02 

-.07 

-.05 

-.12 

-.06 

-.04 

-.02 

Senior 

.54* 

.05* 

j7*** 

j2*** 

jg*** 

j4*** 

.06 

.033 

j2*** 

09*** 

R 2 Background 
Variables 


.03 


02*** 


02*** 


02*** 


.08** 

Gender 

-.22 

-.02 

.05 

.04 

-.02 

-.02 

_ 25*** 

j5*** 

-.06 

-.04 

Race 

-.08 

-.07 

-.02 

-.01 

-.05 

-.03 

-.11 

-.05 

-.03 

-.02 

Senior 

.38 

.04 

j4*** 

jo*** 

J6*** 

j3*** 

.05 

.02 

J J** 

.07** 

Used computer 
/ word 

processor for a 
paper 

.44 

.05 

.01 

.01 

.05 

.04 

-.09 

-.05 

-.02 

-.01 

Searched the 
Internet for 
course related 
material 

g4*** 

jo*** 

J J*** 

j3*** 

.12 

j6*** 

j4*** 

j2*** 

jo*** 

J J*** 

Used email to 
communicate 
with class 

.38 

.05 

jo*** 

09*** 

.07 

.07 

.01 

.008 

-.02 

.07 

Join In 

electronic class 
discussions 

45*** 

J J*** 

o^*** 

JO*** 

0^*** 

jo*** 

08*** 

J J*** 

.05** 

.08** 

Change in R 2 


04*** 


o^*** 


07*** 


03*** 


04*** 

Total R 2 


05*** 


0g*** 


09*** 


.05*** 


04*** 


*p<.05, **p<.01, ***p<.001 
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